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-- The MAILING DATE of this communication appears on the cover sheet with the correspondence address -- 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )^ Responsive to connmunication(s) filed on 07 September 1999 . 
2a)n This action is FINAL. 2b)K This action is non-final. 

3) n Since this application is in condition for allowance except for fornnal matters, prosecution as to the nnerits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims i 

4) ^ Claim{s) 1-55 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) Is/are allowed. 

6) ^ Claim(s) 1-55 is/are rejected. 
/)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10) n The drawing(s) filed on is/are: a)n accepted or b)0 objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1) n The proposed drawing correction filed on is: a)n approved b)^ disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) n The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§ 119 and 120 

13) n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

aOAII b)n Some*c)n None of: 

1 .D Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. . 



3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) 0 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) O The translation of the foreign language provisional application has been received. 

1 5) 0 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 1 20 and/or 121 . 
Attach ment(s) 



1) |2Sl Notice of References Cited (PTO-892) 

2) Q Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) S Information Disclosure Statement(s) (PTO-1449) Paper No(s) 5&6 . 



4) □ Interview Summary (PTO-413) Paper No(s). 

5) CD Notice of Informal Patent Application (PTO-1 52) 

6) 0 Other: 



U.S. Patent and Tradennartt Office 
PTO-326 (Rev. 04-01) 
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DETAILED ACTION 



Drawings 



1 . Figures 1-12 should be designated by a legend such as —Prior Art— because only that which 
is old is illustrated. See MPEP § 608.02(g). A proposed drawing correction or corrected 
drawings are required in reply to the Office action to avoid abandonment of the application. 
The objection to the drawings will not be held in abeyance. 



(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 



2. Claims 1-2, 1 1-19, 30-33, 35, and 46-55 are rejected under 35 U.S.C. 103(a) as being 

obvious over Sherwood et al (US Patent No. 6,212,498), hereinafter referred to as Sherwood, 
in view of Roberts (US Patent No. 5,765,132). 

The applied reference has a common assignee with the instant application. Based upon 
the earlier effective U.S. filing date of the Sherwood reference, it constitutes prior art only under 
35 U.S.C. 102(e). This rejection under 35 U.S.C. 103(a) might be overcome by: (1) a showing 
under 37 CFR 1.132 that any invention disclosed but not claimed in the reference was derived 
from the inventor of this application and is thus not an invention "by another"; (2) a showing of a 
date of invention for the claimed subject matter of the application which corresponds to subject 
matter disclosed but not claimed in the reference, prior to the effective U.S. filing date of the 



Claim Rejections - 35 USC §103 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 



obviousness rejections set forth in this Office action: 
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reference under 37 CFR 1.131; or (3) an oath or declaration under 37 CFR 1.130 stating that the 
application and reference are currently owned by the same party and that the inventor named in 
the application is the prior inventor under 35 U.S.C. 104, together with a terminal disclaimer in 
accordance with 37 CFR 1 .321(c). For appUcations filed on or after November 29, 1999, this 
rejection might also be overcome by showing that the subject matter of the reference and the 
claimed invention were, at the time the invention was made, owned by the same person or 
subject to an obligation of assignment to the same person. See MPEP § 706.02(1)(1) and § 
706.02(1)(2). 

3. Regarding claims 1-2, 1 1-19, 30-33, 35, and 46-55, Sherwood teaches a using a speech 
recognizer to perform speech recognition on a user utterance to produce one or more 
recognition candidates wherein the speech recognizer compares digital values representative 
of the user utterance to a set of acoustic models representative of an active vocabulary of the 
system at Figures 1-12 and col. 3, line 43 continuing to col. 5, line 32. 

Sherwood teaches implementation of an active vocabulary and a backup vocabulary at 

col. 5, lines 24-32, col. 5, line 60 continuing to col. 6, line 19. Additionally, at col. 6, lines 25- 

29, Sherwood teaches searching of the backup dictionary during error correction. 

Sherwood teaches implementation of scoring the recognition candidate at col. 9, line 9 

continuing to col. 14, line 10, including implementation of acoustic model scores and language 

model scores. 

Sherwood teaches implementation of an n-gram language model at col. 5, lines 16-23. 
Additionally, at col. 16, line 13 continuing.to col. 17, line 17, Sherwood teaches generating 
models based on enrollment text. 
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Sherwood does not specifically teach implementation of word fragments or combining 
word fragments or words to form proposed words. However, recognizing word fragments and 
determining if the recognized word fragments can be combined with other word fragments or 
words was well known in the art. 

In a similar field of endeavor, Roberts teaches building speech models for new words in a 
multi-word utterance. Specifically, at col. 4, line 63 continuing to col. 5, line 21, Roberts teaches 
generating recognition candidates for a received user utterance, recognizing fragments of an 
utterance, modifying the recognition candidate and searching the vocabulary for the modified 
recognition candidate before adding the word to the vocabulary. Roberts teaches the speech 
recognition system builds speech models for new words without requiring the user to discretely 
speak the new word such that addition of a new word to the system vocabulary appears as a 
simple correction of a mis-recognized word (col. 2, lines 40-50). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the recognition system of Sherwood to implement recognition of word fragments and 
combining word fragments or words to form proposed words, as taught by Roberts, for the 
purpose of building speech models for new words without requiring the user to discretely speak 
the new word, as suggested by Roberts at col. 2, lines 40-50. 

4. Claims 3 and 34 are rejected under 35 U.S.C. 103(a) as being obvious over Sherwood et al 
(US Patent No. 6,212,498), hereinafter referred to as Sherwood, in view of Roberts (US 
Patent No. 5,765,132), and further in view of Kanevsky et al (US Patent No. 5,835,888). 
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5. Regarding claims 3 and 34, Sherwood teaches a using a speech recognizer to perform speech 
recognition on a user utterance to produce one or more recognition candidates wherein the 
speech recognizer compares digital values representative of the user utterance to a set of 
acoustic models representative of an active vocabulary of the system at Figures 1-12 and col. 
3, line 43 continuing to col 5, line 32. 

Sherwood teaches implementation of an active vocabulary and a backup vocabulary at 

col. 5, lines 24-32, col. 5, line 60 continuing to col. 6, line 19. Additionally, at col. 6, lines 25- 

29, Sherwood teaches searching of the backup dictionary during error correction. 

Sherwood teaches implementation of scoring the recognition candidate at col. 9, line 9 

continuing to col. 14, line 10, including implementation of acoustic model scores and language 

model scores. 

Sherwood does not specifically teach implementation of word fragments or combining 
word fragments or words to form proposed words. However, recognizing word fragments and 
determining if the recognized word fragments can be combined with other word fragments or 
words was well known in the art. 

In a similar field of endeavor, Roberts teaches building speech models for new words in a 
multi-word utterance. Specifically, at col. 4, line 63 continuing to col. 5, line 21, Roberts teaches 
generating recognition candidates for a received user utterance, recognizing fragments of an 
utterance, modifying the recognition candidate and searching the vocabulary for the modified 
recognition candidate before adding the word to the vocabulary. Roberts teaches the speech 
recognition system builds speech models for new words without requiring the user to discretely 
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speak the new word such that addition of a new word to the system vocabulary appears as a 
simple correction of a mis-recognized word (col. 2, lines 40-50). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the recognition system of Sherwood to implement recognition of word fragments and 
combining word fragments or words to form proposed words, as taught by Roberts, for the 
purpose of building speech models for new words without requiring the user to discretely speak 
the new word, as suggested by Roberts at col. 2, lines 40-50. 

Sherwood and Roberts do not specifically teach the word fragments comprise suffixes, 
prefixes and roots. However, implementation of suffixes, prefixes and roots as word fragments 
for models for a speech recognizer was well known in the art. 

In a similar field of endeavor, Kanevsky teaches a statistical language model for 
recognizers with very large vocabularies. Specifically, at col. 4, line 14 continuing to col. 5, line 
8, Kanevsky uses stems, prefixes and endings for training language models for a vocabulary with 
is used to create sub-vocabularies. Probable paths of word components are obtained by 
connecting word components from the dictionary. At col. 2, lines 20-24, Kanevsky teaches the 
system is an improvement because it allows for the building of language models that fiilly 
incorporate the morphological features (prefixes and endings). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the recognition system of Sherwood to implement suffixes, prefixes and roots as word 
fragments, for the purpose of improving the recognizer by the building of language models that 
ftiUy incorporate the morphological features (prefixes and endings), as taught by Kanevsky at 
col. 2, lines 20-24. 
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6. Claims 4-10, 22-29, and 38-45 are rejected under 35 U.S.C. 103(a) as being obvious over 
Sherwood et al (US Patent No. 6,212,498), hereinafter referred to as Sherwood, in view of 
Roberts (US Patent No. 5,765,132), in view of Kanevsky et al (US Patent No. 5,835,888), and in 
further view of Baker et al (US Patent No. 6,092,044), hereinafter referred to as Baker, 

7. Regarding claims 4-10, 22-29, and 38-45, Sherwood teaches a using a speech recognizer 
to perform speech recognition on a user utterance to produce one or more recognition candidates 
wherein the speech recognizer compares digital values representative of the user utterance to a 
set of acoustic models representative of an active vocabulary of the system at Figures 1-12 and 
col. 3, line 43 continuing to col. 5, line 32. 

Sherwood teaches implementation of an active vocabulary and a backup vocabulary at 
col. 5, lines 24-32, col. 5, line 60 continuing to col. 6, line 19. Additionally, at col. 6, lines 25- 
29, Sherwood teaches searching of the backup dictionary during error correction. 

Sherwood teaches implementation of scoring the recognition candidate at col. 9, line 9 
continuing to col. 14, line 10, including implementation of acoustic model scores and language 
model scores. 

Sherwood teaches implementation of an n-gram language model at col. 5, lines 16-23. 
Additionally, at col. 16, line 13 continuing to col. 17, line 17, Sherwood teaches generating 
models based on enrollment text. 

Sherwood does not specifically teach implementation of word firagments or combining 
word fragments or words to form proposed words. However, recognizing word fragments and 
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determining if the recognized word fragments can be combined with other word fragments or 
words was well known in the art. 

In a similar field of endeavor, Roberts teaches building speech models for new words in a 
multi-word utterance. Specifically, at col. 4, line 63 continuing to col. 5, line 21, Roberts teaches 
generating recognition candidates for a received user utterance, recognizing fragments of an 
utterance, modifying the recognition candidate and searching the vocabulary for the modified 
recognition candidate before adding the word to the vocabulary. Roberts teaches the speech 
recognition system builds speech models for new words without requiring the user to discretely 
speak the new word such that addition of a new word to the system vocabulary appears as a 
simple correction of a mis-recognized word (col. 2, lines 40-50). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the recognition system of Sherwood to implement recognition of word fragments and 
combining word fragments or words to form proposed words, as taught by Roberts, for the 
purpose of building speech models for new words without requiring the user to discretely speak 
the new word, as suggested by Roberts at col. 2, lines 40-50. 

Sherwood and Roberts do not specifically teach the word fragments comprise suffixes, 
prefixes and roots. However, implementation of suffixes, prefixes and roots as word fragments 
for models for a speech recognizer was well known in the art. 

In a similar field of endeavor, Kanevsky teaches a statistical language model for 
recognizers with very large vocabularies. Specifically, at col. 4, line 14 continuing to col. 5, line 
8, Kanevsky uses stems, prefixes and endings for training language models for a vocabulary with 
is used to create sub-vocabularies. Probable paths of word components are obtained by 
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connecting word components from the dictionary. At col-. 2, lines 20-24, Kanevsky teaches the 
system is an improvement because it allows for the building of language models that fully 
incorporate the morphological features (prefixes and endings). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the recognition system of Sherwood to implement suffixes, prefixes and roots as word 
fragments, for the purpose of improving the recognizer by the building of language models that 
fiilly incorporate the morphological features (prefixes and endings), as taught by Kanevsky at 
col. 2, lines 20-24. 

Sherwood, Roberts and Kanevsky do not specifically teach implementation of spelling 
rules. However, implementation of spelling rules in a method of adding a word to a speech 
recognition system vocabulary was well known in the art. 

Li a similar field of endeavor, Baker teaches a method of adding a word to a speech 
recognition vocabulary by creating a collection of possible phonetic pronunciations from a 
spelling of a word, wherein the collection is created by comparing the spelling to a rules list of 
letter strings associated with phonemes at col. 15, line 56 continuing to col. 18, line 26. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the recognition system of Sherwood to implement spelling rules for adding new words 
to the system vocabulary as taught by Baker, for the purpose of ensuring that new words to be 
added to the vocabulary are actually valid words. 

8. Claims 20-21 and 36-37 are rejected under 35 U.S.C. 103(a) as being obvious over 
Sherwood et al (US Patent No. 6,212,498), hereinafter referred to as Sherwood, in view of 
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Roberts (US Patent No. 5,765,132), and in further view of Baker et al (US Patent No. 6,092,044), 
hereinafter referred to as Baker. 

9. Regarding claims 20-21 and 36-37, Sherwood teaches a using a speech recognizer to 
perform speech recognition on a user utterance to produce one or more recognition candidates 
wherein the speech recognizer compares digital values representative of the user utterance to a 
set of acoustic models representative of an active vocabulary of the system at Figures 1-12 and 
col. 3, line 43 continuing to col. 5, line 32. 

Sherwood teaches implementation of an active vocabulary and a backup vocabulary at 
col. 5, lines 24-32, col. 5, line 60 continuing to col. 6, line 19. Additionally, at col. 6, lines 25- 
29, Sherwood teaches searching of the backup dictionary during error correction. 

Sherwood teaches implementation of scoring the recognition candidate at col. 9, line 9 
continuing to col. 14, line 10, including implementation of acoustic model scores and language 
model scores. 

Sherwood teaches implementation of an n-gram language model at col. 5, lines 16-23. 
Additionally, at col. 16, line 13 continuing to col. 17, line 17, Sherwood teaches generating 
models based on enrollment text. 

Sherwood does not specifically teach implementation of word fragments or combining 
word fragments or words to form proposed words. However, recognizing word fragments and 
determining if the recognized word fragments can be combined with other word fragments or 
words was well known in the art. 

In a similar field of endeavor, Roberts teaches building speech models for new words in a 
multi-word utterance. Specifically, at col. 4, line 63 continuing to col. 5, line 21, Roberts teaches 
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generating recognition candidates for a received user utterance, recognizing fragments of an 
utterance, modifying the recognition candidate and searching the vocabulary for the modified 
recognition candidate before adding the word to the vocabulary. Roberts teaches the speech 
recognition system builds speech models for new words without requiring the user to discretely 
speak the new word such that addition of a new word to the system vocabulary appears as a 
simple correction of a mis-recognized word (col. 2, lines 40-50). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the recognition system of Sherwood to implement recognition of word fragments and 
combining word fragments or words to form proposed words, as taught by Roberts, for the 
purpose of building speech models for new words without requiring the user to discretely speak 
the new word, as suggested by Roberts at col. 2, lines 40-50. 

Sherwood and Roberts do not specifically teach implementation of spelling rules. 
However, implementation of spelling rules in a method of adding a word to a speech recognition 
system vocabulary was well known in the art. 

In a similar field of endeavor, Baker teaches a method of adding a word to a speech 
recognition vocabulary by creating a collection of possible phonetic pronunciations fi-om a 
spelling of a word, wherein the collection is created by comparing the spelling to a rules list of 
letter strings associated with phonemes at col. 15, line 56 continuing to col. 18, line 26. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the recognition system of Sherwood to implement spelling rules for adding new words 
to the system vocabulary as taught by Baker, for the purpose of ensuring that new words to be 
added to the vocabulary are actually valid words. 
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10. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Angela A. Armstrong whose telephone number is 703-308-6258. 
The examiner can normally be reached on Monday-Thursday 7:30-5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha Banks-Harold can be reached on (703) 305-4379. The fax phone numbers 
for the organization where this application or proceeding is assigned are 703-872-9314 for 
regular communications and 703-872-9314 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-306-0377. 



Angela A. Armstrong 

Examiner 

Art Unit 2654 



AAA 

April 21, 2003 



MARSHA D. BANKS-HAROLD 
SUPERVISORY PATENT EXAMINER 
TECHNOtOQY CENTER 2600 



